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I.  INTRODUCTION 


This  report  presents  the  results  of  Systems  Control 
Technology,  Inc.  (SCT)'s  preliminary  study  of  maintenance 
decision  models  for  evaluation  of  the  TF34  maintenance  process 
both  with  and  without  the  Turbine  Engine  Monitoring  System 
(TEMS).  The  order  of  presentation  will  be  as  follows:  Section 
II  presents  a  summary  of  relevant  technical  background  material 
in  decision  analysis  methods  and  in  the  TF34  maintenance 
process.  In  Section  III,  the  models  developed  by  SCT  under  this 
study  are  discussed.  Model  structure  and  parameters  as  well  as 
input  and  output  are  treated.  Section  IV  outlines  the 
preliminary  plan  for  model  evaluation.  Included  in  this  plan 
will  be  methods  for  data  collection,  model  evaluation  criteria, 
as  well  as  solution  techniques  and  algorithms  for  the  actual 
model  evaluation.  Section  V  solves  a  small  test  case  while 
Section  VI  draws  conclusions  and  makes  recommendations  as  to 
study  areas  and  activities  for  future  work  in  this  area.  Section 
VII  presents  reformulated  versions  of  the  models  of  Section  III 
in  order  to  emphasize  decision  points  and  to  point  out  places 
where  human  or  judgemental  factors  enter  into  the  model. 


II.  BACKGROUND 


This  section  presents  an  overview  of  technical  background 
material  useful  in  the  development  of  the  TF34  maintenance  models 
(Section  III)  and  an  plan  for  their  evaluation  (Section  IV).  The 
material  falls  into  two  general  categories:  decision  analysis 
techniques  and  the  TF34  maintenance  process.  Section  2.1  treats 
the  former  subject  while  Section  2.2  treats  the  latter. 

2.1  DECISION  ANALYSIS  TECHNIQUES 

Decision  analysis  is  a  discipline  within  management  science 
which  seeks  to  apply  logical,  mathematical  and  scientific 
procedures  to  the  decision  problems  of  top  management.  Such 
problems  are  characterized  by  the  following:  uniqueness, 
importance,  uncertainty,  long  run  implications  and  complex 
preferences.  Decision  analysis  provides  a  logical  framework  for 
balancing  all  these  considerations  while  permitting  mathematical 
modeling  of  the  decision  process,  computational  implementation  of 
the  model,  and  quantitative  evaluation  of  results. 

Much  literature  exists  on  the  subject  of  decision  analysis. 
Only  a  brief  overview  of  some  of  the  concepts  and  subject  areas 
to  which  it  has  been  applied  will  be  discussed  here.  A  more 
extensive  introductory  discussion  can  be  found  in  [1]  and  the 
references  listed  there. 

Figure  2.1  illustrates  a  general  framework  into  which  all 
decision  analysis  modeling  efforts  can  be  classified.  Given  a 
set  of  "a  priori"  information  or  data,  there  are  five  basic 
steps:  model  development,  model  simplification,  model 
evaluation,  cost  benefit  analysis  and  collection  of  new 
information.  These  steps  form  a  cycle  allowing  for  continual 
update  of  the  model  results  as  well  as  the  model  itself  as  new 
information  becomes  available.  Following  model  evaluation,  a 
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cost  benefit  analysis  examines  the  trade-off  between  the  value  of 
acquiring  new  or  perfect  informaton  and  the  cost  of  acquisition. 

If  the  cost  exceeds  the  value,  the  decision  analysis  stops, 
conclusions  are  drawn  and  appropriate  actions  taken. 

The  model  development  phase  involves  the  creation  of  a  i 

structural  model  of  the  decision  process  under  study  as  well  as 
value  and  time  preference  models  which  represent  the  decision 
maker's  opinion  as  to  the  worth  of  the  various  possible  outcomes 
to  the  structural  decision  model. 

The  structural  model  often  appears  as  a  decision  tree .  A 
decision  tree  is  composed  of  dec  i s i on  variables  (under  control  of 
decision-maker),  state  vari ables  (random,  under  control  of 
"nature"),  act  ions  (results  of  decisions)  and  outcomes  (results 
of  chance  or  state  variables).  Figure  2.2  provides  an  example 
tree.  Decision  variables  are  represented  by  squares,  state 
variables  by  circles,  and  outcomes  by  triangles. 

The  size  of  the  tree  is  bounded  by  the  number  of  alternative 
actions  for  each  decision  variable  and  the  number  of  possible 
chance  outcomes  of  each  state  variable.  The  tips  of  the  tree 
branches  represent  outcomes  of  the  entire  decision  process,  i.e. 
whatever  it  is  the  decision-maker  would  like  to  know  in 
retrospect  to  determine  how  the  problem  came  out. 

The  value  model  development  consists  of  specification  of  the 
costs  (measured  by  decision-maker's  objectives)  of  making  an 
action  and  the  value  (to  the  decision-maker)  of  each  overall 
outcome  in  the  structural  model. 

The  time  preference  model  simply  represents  the 
decision-maker's  time  preference  for  various  outcomes  of  the 

\ 

structural  model.  Good  outcomes  are  preferred  sooner  and  bad 
ones  later. 

t 

Once  these  three  models  have  been  developed,  the  worth  to 
the  decision-maker  of  any  possible  outcome  (fixing  all  the 
decision  and  state  variables  to  a  single  value  can  be 
determined.  The  model  simplification  phase  of  decision  analysis 
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Figure  2.2  Example  From  TF  34  Maintenance  {W 


involves  performing  a  sensitivity  analysis,  i.e.  observing  how 
changes  in  various  decision  and  state  variables  affect  worth. 
Variables  which  have  little  to  no  effect  on  the  overall  worth  are 
dropped  from  the  model,  simplifying  the  problem. 

The  model  evaluation  phase  involves  two  steps.  The  first  is 
the  spec i f icat i on  of  remaining  inputs  to  the  problem,  the 
probability  distributions  of  state  variable  outcomes  and  the;  risk 
preference  of  the  decision-maker.  The  second  is  the  solution  of 
the  decision  problem  given  these  inputs  anc  validation  of 
results.  Optimal  action(s)  and  their  wort';  to  the  decision-maker 
are  computed  as  well  as  sensitivity  of  the  results  to  various 
input  quantities.  Low  sensitivity  establishes  validity  of  the 
result.  Some  standard  mathematical  programming  solution 
techniques  and  algorithms  can  be  found  in  Ref.  2. 

Due  to  the  randomness  inherent  in  the  state  variables,  a 
decision  maker's  risk  preference  (usually  expressed  as  a  utility 
function)  is  needed  to  uniquely  determine  the  best  policy.  An 
"EMV"  decision-maker  is  one  who  acts  on  the  basis  of  percentages 
or  mean  values.  In  contrast,  a  risk-averse  person  is  one  who  is 
willing  to  trade-off  some  of  his  expected  income  for  protection 
against  bad  outcomes.  For  the  decision-maker  who  is  confronted 
with  multi -objective  decisions,  mult j -attribute  utility  and  value 
theoretic  methods  are  available  [3], 

Following  the  codel  evaluation  phase,  there  are  two  possible 
decisions:  act  on  the  basis  of  current  information  and  model 
results  or  gather  more  information  and  run  through  the  decision 
analysis  cycle  again.  A  cost-benefit  analysis  is  done  to 
determine  whether  ;r  not  the  cost  of  gathering  new  information 
and  delaying  a  decision  to  act  exceeds  the  value  of  that 
information  in  reducing  the  uncertainty  in  the  state  variables, 
chus  producing  more  certain  conclusions.  If  costs  are  greater, 
then  the  optimal  action  is  to  stop. 

Although  each  decision  .analysis  is  unique,  the  underlying 
techniques  involved  in  performing  the  previously  mentioned  phases 
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are  application  independent.  These  techniques  have  been  applied 
profusely  in  a  variety  of  fields  from  health  care  (see  Ref.  4)  to 
systems  engineering  to  medicine  (see  Refs.  S  and  6).  They  have 
not  as  yet  been  used  extensively  in  the  logistics  field,  an 
application  which  is  treated  in  the  remainder  of  this  report. 

This  subsection  concludes  with  a  short  discussion  of  the 
feasibility  of  utilizing  decision  analysis  as  a  tool  in  the  first 
place.  The  answer  to  this  question  is  that  it  depends  on  the 
problem  and  more  specifically  the  objectives  or  goals  of  the 
decision-maker.  Some  objectives  naturally  lend  themselves  to 
mathematical  expression  (quantifiable)  while  others  do  not 
(nonquantifiable) ,  Prime  examples  of  the  latter  in  TF34 
maintenance  include  such  criteria  as  acceptance  of  system  outputs 
on  all  user  levels  or  improved  understanding  of  the  engine  by 
maintenance  personnel.  It  can  be  said,  however,  that  the 
flexibility  of  decision  analysis  techniques  and  their  scope  of 
applicability  exceeds  that  of  most  other  operations  research 
techniques  and  so  chances  are  good  that  at  least  a  significant 
portion  of  any  engineering  decision  problem  will  fall  under  this 
scope. 

Advantages  and  disadvantages  of  decision  analysis  are  listed 
in  Table  2.1. 

2.2  THE  TF34  MAINTENANCE  PROCESS 

This  section  discusses  the  Air  Force  TF34  engine  maintenance 
process.  First,  an  overview  of  the  maintenance  organization  is 
given  followed  by  a  discussion  of  the  maintenance  decision 
process.  Finally  the  management  of  engine  information  through 
use  of  CEMS  IV  is  described. 

The  TF34  engine  is  employed  by  the  Tactical  Air  Command 
(TAC)  in  A10  aircraft.  The  typi  al  TAC  mission  requires  rapid 
deployment  and  immediate  fighting  capability  of  aircraft.  Thus 
TAC  uses  a  production  oriented  maintenance  organization  (POMO) 


7 


Table  2.1 

Advantages/Disadvantages 


•  ADVANTAGES 

-  example:  problem  globally 

-  STIMULATES  CONSIDERATION  OF  VIABLE  OPTIONS 

-  ENHANCES  COMMUNICATION 

-  ESTABLISHES  DATA  COLLECTION  GUIDELINES 

-  QUANTIFIES  UTILITIES/PREFERENCES 

-  PROVIDES  CAPABILITY  FOR  UPDATING  ANALYSIS 

•  DISADVANTAGES 

-  LACK  OF  POLITICAL  CONSIDERATIONS 

-  LACK  OF  ENGINEERING  JUDGEMENT 

-  ARTICULATION  SLOWS  THOUGHT  PROCESS 

-  INCOMPLETE  "COST"  OBJECTIVE  FUNCTIONS 
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oriented  towards  maintaining  deployable,  independent 
squadron-size  fighting  units  capable  of  supporting  high  sortie 
rates  and  surviving  in  a  forward  location.  Air  Force  regulation 
66-5  [7]  describes  the  POMO,  its  maintenance  management  policy 
and  procedures. 

Unlike  the  traditional  centralized  maintenance  concept 
(AFM-66-1  [8]),  the  POMO  decentralizes  decision-making.  Rather 
than  organizing  people  into  specialized  tasks,  personnel  and 
equipment  are  organized  into  sortie  producing  elements.  Table 
2.2  summarizes  the  major  differences  in  AFM  66-1  and  AFR  66-5. 

Figure  2.3  shows  how  POMO  operates.  The  aircraft  generation 
squadron  (AGS)  has  the  responsibility  to  maintain  or  generate 
aircraft  to  support  the  unit  direct  sortie  requirements.  These 
are  the  same  whether  in  peace  or  in  combat.  The  AGS  handles 
flightline  or  on-aircraft  maintenance.  The  component  repair 
squadron  (CRS)  and  equipment  maintenance  squadron  (EMS)  perform 
off-aircraft  maintenance  and  in-shop  work.  The  activities  of  the 
AGS,  CRS,  and  EMS  are  coordinated  by  a  job  control. 

Figure  2.4  summarizes  the  engine  maintenance  decision 
process  without  the  Turbine  Engine  Monitoring  System  (TEMS). 
Maintenance  > s  done  in  one  of  three  locations:  on  flightline,  at 
JEIM  (jet  engine  intermediate  maintenance)  or  base,  or  at  depot. 
Flightline  maintenance  is  done  on  aircraft  (by  the  AGS).  If 
troubleshooting  on  the  line  indicates  a  problem  requiring  engine 
removal,  the  engine  is  then  either  repaired  at  base  or  sent  to 
depot,  depending  on  the  type  of  maintenance  required.  Repaired 
engines  become  part  of  a  pool  of  spares  which  are  installed  in 
aircraft  as  needed. 

Figure  2.5  illustrates  in  more  detail  that  portion  of  the 
unscheduled  engine  maintenance  decision  process  influenced  by 
TEMS.  TEMS  is  useful  in  assisting  engine  problem  symptom 
detection  as  well  as  flightline  troubleshooting.  The  optimal 
integration  of  the  TEMS  into  the  TFL4  maintenance  procedure  has 
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AFR  66-5  POMO 


Figure  2.4  Maintenance  Decision  Processes 


Figure  2.5  AIO/TEMS  Maintenance  Scenario 
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not  >'et  been  determined  but  can  be  as  part  of  the  maintenance 
decision  analysis  and  improvement  program  (Section  VI). 

The  general  procedure  is  as  follows*  there  are  ACFT 

(Aircraft)  NO  GO  and  TEMS  NO  GO  indicators  located  in  the  forward 

wheel  well  of  each  TEMS  equipped  aircraft.  If  both  of  these  are 

"green",  then  the  flight  data  is  collected  and  the  aircraft 

turned  around  in  accordance  with  normal  procedures.  If  either 

the  ACFT  NO  GO  indicator  is  "not  green"  or  the  pilot  or  crew 

chief  squawks,  the  crew  notifies  dispatch  through  an  AFTO  781E 

form.  Dispatch  then  notifies  job  control  which  dispatches  a 

mechanic  (AFTO  349)  to  troubleshoot  the  detected  symptom. 

Troubleshooting  is  then  done  by  the  mechanic  on  the  basis  of 

information  received  from  AFTO's  781  and  349,  AGE  (aerospace 

ground  equipment)  and  the  TEMS  DDU  display.  If  a  problem  is 

verified,  engine  maintenance  is  done  -  if  not,  troubleshooting  is 

done  on  the  TEMS.  If  maintenance  requires  engine  removal,  repair 

then  proceeds  just  as  without  TEMS  in  Figure  2.4.  A  TEMS  NO  GO 

"not  green"  indicator  will  not  cause  immediate  scrapping  of  a 

mission,  however  repair  or  replacement  of  TEMS  should  be  done  as 

soon  as  possible. 

* 

The  final  portion  of  this  section  describes  the  management 
of  engine  information  through  CEMS  IV.  Figure  2.6  summarizes 
this  flow  of  information.  CEMS  information  will  be  stored  both 
at  base  and  at  a  central  data  bank  (CDB).  At  base  CEMS  will 
support  intermediate  shop,  integrate  base  data  sources,  and 
condense  data  for  analysis,  as  well  as  transfer  to  the  CDB  where 
users  will  be  seeking  less  detailed  information.  Organizations 
such  as  ALC,  AFLC  HQ,  and  MAJCOM  HQ  will  have  access  to  the  CDB. 
At  the  CDB  level,  CEMS  information  will  support  fleet  visibility 
for  readiness,  depot  maintenance  as  well  as  CIP  and  maintenance 
analysis . 

CEMS  IV  capabilities  include  the  storage  of  all  er. ine 
condition  information  necessary  to  support  the  repair  cycle 
monitor  (RCM)  process,  the  ability  to  integrate  such  information 
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Figure  2.6  Management  of  Engine  Information 


into  useful  and  timely  data  elements,  and  the  ability  to  access 
such  data  at  appropriate  levels  and  in  usable  formats.  Engine 
condition  information  includes  operating  time,  temperature  and 
cycle  data,  maintenance  actions  and  oil  analysis  results  among 
others.  Such  raw  data  can  be  integrated  into  more  useful  forms 
for  use  in  diagnostics,  tracking  critical  components,  forecasting 
engine  health,  scheduling  preventative  maintenance,  o',  generation 
of  input  parameters  to  maintenance  decision  models. 

A  CEMS  IV  prototype  program  is  currently  in  progress.  Its 
goals  are  to  implement  a  prototype  that  supports  engine 
management  functions  at  the  base,  MAJCQM  and  ALC  levels, 
providing  a  controlled  environment  in  which  to  test,  evaluate  and 
refine  the  software  system.  Other  goals  are  to  integrate  data 
sources  and  structures  from  the  oil  analysis  program  (OAP), 
maintenance  data  collection  system  (MDC),  the  maintenance 
management  information  and  control  system  (MMICS)  and  the  TF34 
TEMS. 
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III.  THE  MAINTENANCE  DECISION  MODELS 


This  section  describes  the  block  diagram  decision  models 
developed  by  SCT  for  purposes  of  modeling  the  TF34  maintenance 
process.  There  are  two  types  of  diagrams:  high  level  decision 
models  and  detailed  maintenance  procedure  models.  Output  from 
the  detailed  models  feeds  into  the  high  level  models  as  shown  in 
Figure  3.1,  supplying  the  input  troubleshooting  procedure  costs. 
Section  3.1  discusses  the  high  level  models  while  Section  3.2 
treats  the  detailed  maintenance  models. 

Before  getting  into  the  model  details,  a  few  points 
concerning  assumptions  should  be  made.  Only  maintenance 
influenced  by  TEMS  is  considered,  i.e.  unscheduled  maintenance  of 
aircraft  which  have  been  grounded  due  to  symptoms  detectable  by 
TEMS  (most  symptoms).  Inclusion  of  other  symptoms  or  types  of 
maintenance  within  this  structure  would  be  a  trivial  exercise  if 
necessary  at  a  later  time.  Engine  troubleshooting  and 
maintenance  procedures  without  TEMS  are  assumed  to  be  as  stated 
in  TO  2 J-TF34 -6  (see  Ref.  9,  Ch.  10)  while  those  with  TEMS  are 
assumed  to  be  those  in  the  USAF  A-10  TEMS  Training  Manual  [10). 
TEMS  troubleshooting  is  assumed  to  be  done  as  specified  in  Ref. 

11 . 

3.1  HIGH-LEVEL  BLOCK  DIAGRAMS 

The  high-level  block  diagrams  are  decision  analysis  models 
for  the  TF34  maintenance  process  with  and  without  TEMS.  Figures 

3.2  and  3.3  exhibit  the  models  respectively  without  and  with 
TEMS.  For  purposes  of  optimal  visual  display,  each  of  Figures 

3.2  and  3.3  appear  over  three  pages.  The  keys  to  or  verbal 
descriptions  of  model  notation  appear  in  Tables  3.1  and  3.2. 

Theris  are  eleven  symptoms  detectable  by  TEMS  (on  DDU  display 
window  F)  plus  the  possibility  of  no  symptoms  being  detected. 
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(Concluded) 


SYMPTOM 


•34  Ma 


9*a -u  i mm 

M 


PROCEDURE 


Figure  3.3  (Concluded) 


Table  3,1 

Key  fl  To  High  Level  Block  Diagram  Without  TEMS 
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Table  3.2  (Continued) 


j  Indexes  events  by  which  the  synptoms  were  detected. 


The  rows  in  Figures  3.2  and  3.3  correspond  to  these  symptoms. 

The  symptom  of  overtemp  is  broken  down  further  into  "hot  start" 
(symptom  1)  and  "other  than  start  cycle"  (symptom  1')  due  to  the 
differing  troubleshooting  procedures  for  each. 

For  both  models,  the  flow  is  from  left  to  right.  Symptoms 
are  detected  in  one  of  four  possible  ways,  labelled  events . 

These  are: 

•  event  "a":  pilot  squawk  only,  TEMS  okay 

•  event  "b":  only  TEMS  detects  problem 

•  event  "c":  pilot  and  TEMS  detect 

•  event  "d":  pilot  squawk,  TEMS  not  there  or  not 
operative 

Without  TEMS,  only  event  "d •  can  occur  while  with  TEMS,  any  of 
the  events  are  possible.  This  accounts  for  the  single  versus 
multiple  inputs  into  each  row  of  the  models  in  Figures  3.2  and 
3.3. 

Following  symptom  detection,  a  maintenance  check  (  M  )  is 
done  to  try  and  duplicate  the  symptom.  This  check  will  depend  on 
the  symptom  and  can  either  be  in  the  form  of  a  ground  run  or  some 
simpler  test.  Whether  or  not  the  symptom  is  duplicated  is  a 
chance  node  in  the  diagram.  f 

Following  the  maintenance  check,  troubleshooting  procedures 
are  initiated.  These  depend  on  the  symptom  detection  event  and 
the  result  of  the  maintenance  check.  Procedures  differ  for  the 
cases  with  and  without  TEMS.  Procedure  blocks  on  the  diagrams 
indicate  sources  where  they  are  documented.  The  troubleshooting 
procedure  blocks  include  maintenance  checks  and  repair  or 
replacement  actions.  If  a  symptom  is  duplicated,  or  the  TEMS 
built  in  test  equipment  (BITE)  indicates  a  failure  then 
troubleshooting  is  initiated  on  the  engine.  If  the  TEMS  built  in 
test  equipment  (BITE)  indicates  a  failure  (of  TEMS)  or  if  it  does 
not  but  the  symptom  is  not  duplicated  then  troubleshooting  is 
done  on  the  TEMS.  Otherwise,  no  action  is  taken  and  the  engine 
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is  given  a  functional  check.  The  outcome  of  the  functional  check 
is  either  a  working  engine  (OK)  or  an  abort  (A)  in  which  case  the 
engine  or  aircraft  is  sent  back  for  further  troubleshooting.  It 
has  been  assumed  that  an  aircraft  which  passes  the  functional 
check  will  also  fly  the  next  mission  successfully. 

Inputs  to  the  high  level  block  diagram  models  will  include 
costs  for  actions  and  chance  fork  probabilities.  Actions  include 
maintenance  and  functional  checks  as  well  as  troubleshooting  and 
maintenance  procedures.  Chance  forks  occur  at  maintenance  checks 
(outcomes  -  duplication  or  non-duplication  of  symptoms)  and  at 
functional  or  operational  checks  (outcomes  ■  engine  OK  or  not 
OK).  The  probabilities  will  change  as  a  function  of  the  symptom 
detection  event  (j).  In  the  non-TEM3  model  there  is  only  a 
single  possible  detection  event  (pilot  squawk),  thus  chance  fork 
probabilities  appear  as  functions  of  symptom  (i)  only. 

"Costs"  are  not  limited  to  dollar  values  for  outcomes  or 
expenses  incurred  for  actions,  they  include  other  possible 
objectives  such  as  engine  downtime,  manhours,  or  engine  test  time. 

3.2  DETAILED  BLOCK  DIAGRAMS 

The  purpose  of  the  detailed  block  diagrams  is  to  provide 
cost  estimates  for  the  procedure  blocks  in  the  high  level 
decision  models.  The  detailed  diagrams  are  not  decision  analysis 
models,  although  they  could  be  formulated  as  such.  They  model 
the  details  of  various  TF34  troubleshooting  procedures.  Figures 
3.4  and  3.5  are  the  detailed  diagrams  for  troubleshooting  the 
symptom  of  an  "overtemp,  other  than  start  cycle"  respectively 
without  and  with  TEMS.  Table  3.3  provides  a  key  to  these 
diagrams  while  Tables  3.4  and  3.5  list  and  define  the  possible 
outcomes,  without  and  with  TEMS. 

The  model  structure  consists  of  checks  (0),  maintenance 
actions  (□)  and  outcomes  (^).  Input  required  includes  the 
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Figure  3.4  Detailed  Flow  Diagram,  No  TEMS 


led  Flow  Diagram,  With  TEMS 


Table  3.3 


Key  #4  To  Detailed  Block  Diagrams 


CODE 

TABLE  OF  CHECKS:  SYMPTOM  V 

Checks  Without  TEMS 

CHECK 

OPTIONS 

Cl 

Ng/ITT  Indicator  Systems 

0,1 

C2 

Control  Disable  Check 

0,1 

C3 

Ng  Reaches  99-1 00%  But  ITT,  Ng  Remain  Low 

0,1 

C4 

Feedback  Cable  Secure? 

0,1 

C5 

Feedback  Cable  Bound  Up? 

0,1 

C6 

Disconnect  Feedback  Cable: 

Does  It  Require  More  Than  4  lb.  Force  To  Move! 

>  0,1 

C7 

Feedback  Cable:  Has  Problem  Occurred  Before 

oo  This  Engine? 

0,1 

C8 

Fuel  Control  Lever:  Check  Travel  and 

Freedom  Of  Movement 

2  =  Hung  Up,  1  =  Binding,  0  =  Okay 

0,1,2 

C9 

Continuity  Of  Thermocouple  and  Junction  Box 

2  »  ITT  Overshoot  if  Disconnect  J3,  J4 

1  =  ITT  Overshoot  if  Disconnect  One  of  J3,  J4 

0,1,2 

0  *  No  ITT  Overshoots  if  Either  J37  J4  disconnected 

CIO 

Control  Amplifier 

0,1 

Cll 

Torque  Motor  Winding  Continuity 

0,1 

Cl  2 

Idle  Speed 

1  *  Below  55%,  0  =  Above  55% 

Checks  Requirinq  TEMS 

0,1 

T1 

WF  Override  (G-7)  2  * 

On,  PILOT  1 

1  * 

On,  PILOT  : 

0  « 

Not  On 

T2 

FI  Display  Light  2  ■ 

Level  2 

1  - 

Level  1 

0  - 

32 

Not  On 

—  __ — — . —  - . -  • 

Table  3.3  (Continued) 


TABLE 

OF  CHECKS  continued 

CODE 

CHECK 

T3 

ITT  Reading  (84) 

2  » 

1  ■ 

0  « 

T4 

Compare  B1 ,  B4,  B5,  Cl  From  Left  and 

1  * 

Right  Engines 

0  a 

T5 

F10  Light  on  DDU 

1  - 

0  « 


Other  Checks 

BO  Borescope  Engine 


1  - 

0  » 


0:  No  Problem  Detected 


OPTIONS 


Greater  Than  1000°C  n 
Between  927°  and  1000UC 
Less  Than  927°C 

All  Agree  Except  84 
Not  Option  1 

On 

Off 


Problems  Detected 
No  Problems  Detected 


1:  Problem  Detected 


J  IM  IIHIPMUP 


Table  3.4 

Key  SS  To  Detailed  Block  Diagram  Without  TEMS 


TA8LF  OF  OUTCOMES  FOR 


PROCEDURE 
TO  2J-TF34-6 
Par.  10-10F. 


Repair  Instruments 

Replace  Feedback  Cable 

Replace  Feedback  Cable  and  Fuel  Control 

Remove  Engine 

Replace  Fuel  Control 

Replace  White  Harness 

Replace  Thermocouple  Harness 

Replace  Control  Amp 

No  Repair  /  Replacement 


Table  3.5 

Key  fS  To  Detailed  Block  Diagram,  With  TEMS 


TABLE  OF  OUTCOMES  FOR: 


PROCEDURE 
TM  Table  4.1,  F-l 


A 

No  Maintenance  Action 

A 

Borescope  Engine 

A 

Borescope  and  Remove  Engine 

A 

Remove  Engine 

A 

Repair  Instruments 

A 

Repair/ Rep lace  Harness 

A 

Replace  Control  Amp 

A 

Replace  Fuel  Control 

A 

Replace  CIT  Sensor 

(procedure 


TM  Table  4.1 
no  (Stall) 


Check  for  Stall 


•’costs"  of  the  various  checks  and  actions  as  well  as  the  expected 
frequency  of  each  outcome.  Given  these  inputs  and  the 
maintenance  procedure,  costs  and  frequency  for  each  outcome  are 
computed.  By  weighting  outcome  costs  by  their  frequencies,  an 
expected  procedure  "cost"  can  be  computed  and  used  as  input  in 
the  appropriate  high-level  block  diagram  model. 
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IV.  MODEL  EVALUATION  PLAN 


This  section  describes  an  evaluation  plan  for  the 
maintenance  models  presented  > n  Section  III.  Included  in  this 
plan  are  model  evaluation  criteria  and  data  requirements, 
prospective  data  sources  and  collection  methods  for  model  inputs, 
and  solution  techniques. 

Decision  analysis  models  as  discussed  in  Section  2.1  require 
as  input  the  chance  fork  probabilities,  costs  for  decisions, 
values  for  outcomes  and  utility  functions  demonstrating  the  risk 
preferences  of  the  decision-maker.  Table  4.1  lists  data 
requirements  other  than  utility  functions.  These  are  classified 
as  model  parameters  (chance  fork  probabilities  in  the  high  level 
models  and  symptom  detection  event  frequencies)  and  model  costs. 
"Costs"  are  defined  in  terms  of  the  multiple  model  evaluation 
criteria.  These  include  $-cost,  manhours  required,  engine 
downtime,  engine  test  hours  and  engine  test  cycles  required  to 
complete  the  various  checks,  maintenance  actions  and  tests  which 
appear  in  the  models  of  Section  III.  Also  required  to  produce 
"costs"  are  the  probabilities  of  occurrence  for  each  outcome  of 
the  detailed  block  diagram  models. 

The  final  data  requirement  is  a  utility  function 
representing  the  decision-maker's  preference  for  various  decision 
model  outcomes  as  a  function  of  those  outcomes.  The  simplest 
utility  (linear  function)  is  exhibited  by  a  person  who  acts 
solely  on  the  basis  of  expected  return.  A  "risk  averse"  person 
will  be  more  apt  to  choose  a  policy  which  will  protect  himself 
against  bad  outcomes  while  trading  off  some  of  his  expected 
return.  A  utility  function  quantifies  this  behavior  in  an 
individual.  In  absence  of  other  information,  the  "expected 
value"  assumption  is  often  made. 

Data  sources  for  the  aforementioned  model  input  data 
requirments  are  summrized  in  Figure  4.1.  In  the  figure,  data 
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Data  Requirements 


MODEL  PARAMETERS 

A.  P.,(j)  ,  1  *  1,  1',  2,  ...»  11  and  j  *  a,  bt  c,  d 

1  *  probability  pilot  or  crew  chief  detects  symptom  1 

and  ground  run  duplicates  It 
(a  measure  of  pilot  reliability) 

B.  q.* (j)  ,  i  =  1,  V,  2,  ...»  11  and  j  «  a,  b,  c,  d 

«  probability  functional  check  Is  successful  given  pilot 
detects  and  ground  run  duplicates  symptom  i 
(a  measure  of  maintenance  effectiveness  or 
reliability) 

C.  r-(j)  ,  i  «  1,  I',  2,  11  and  j  -  a,  b,  c,  d 

1  «  probability  that  functional  check  is  successful  given 

the  pilot  detects  but  the  grojnd  run  is  unable 
to  duplicate  symptom  i 

(1-r  is  a  measure  of  ground  run  reliability) 

D.  PQ(j)  ,  j  -  a0,bQ 

=  probability  next  mission  is  successful  given  no 
symptoms  detected 

E.  Pa,  Pb,  Pc,  Pd,  the  relative  frequencies,  of  events 
pVPbo 

(Pa  +  Pb  +  Pc  +  Pd  *  1  and  PaQ  +  PbQ  *  1) 

Where 

-  ) 

event  a:  P,  F,  F..  c:  P,  F,  aQ:  P,  F,  F^  all  i 

b:  F,  B,  Ft  d:  P,  B  bQ:  F,  B 


MODEL  COSTS 

A.  Cost  ($) 

1.  For  each  check  (0)  in  detailed  flow  diagrams 

2.  For  each  action  (  □  )  In  detailed  flow  diagrams 

3.  For  each  test  {  M  or  0  )  in  high-level  diagrams 

B.  Manhours  to  complete 

1 .  checks 

2.  actions 

3.  tests 


Table  4.1  (Continued) 


C.  Engine  downtime  due  to: 

1 .  checks 

2.  actions 

3.  tests 

0.  Hours  of  engine  test  required 

1 .  checks 

2.  actions 

3.  tests 

E.  Cycles  of  engine  test  required 

1 .  checks 

2.  actions 

3.  tests 

F.  Outcome  probabilities 

1.  For  each  check  (0)  In  detailed  flow  diagrams 


III.  VALUES  OF  ‘'OUTCOMES11  FOR  HIGH  LEVEL  FLOW  DIAGRAMS 

A.  Cost  of  next  mission  abort  or  engine  functional  check  failure. 
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source  categories  are  on  the  left,  data  requirements  in  the 
middle  and  models  in  the  right  column.  Without  TEMS,  model 
parameters  can  be  determined  through  manufacturer  collected  AFTO 
781E  and  349  data.  For  example,  General  Electric  has  collected 
412,900  TF34  engine  flying  hours  from  1976-1980  of  data  on 
inflight  power  losses,  shutdowns,  aborts,  LRU  maintenance  and 
shop  visits.  Event  occurrences  are  logged  along  with  detailed 
cause  (e.g.  T2  inlet  sensor  removal). 

With  TEMS,  the  data  has  not  yet  been  collected  but  a  unique 
opportunity  exists  from  Oct.  1982  through  Oct.  1983  to  use  the 
OEMS  IV  prototype  system  for  collection  of  such  data  from  the 
TEMS  squadron  evaluation. 

Model  costs  will  be  determined  through  compilation  of 
information  in  various  Air  Force  documents.  These  are  listed  in 
Table  4.2.  This  table  provides  a  more  detailed  listing  of  other 
data  sources.  Utility  functions  cannot  be  obtained  other  than 
through  interviews  with  the  decision  maker. 

Given  the  models  of  Section  III  and  a  set  of  input  data,  the 
detailed  block  diagrams  must  first  be  evaluated  to  provide  costs 
for  the  "procedure"  blocks  in  the  high  level  diagram  decision 
analysis  models.  The  high  level  models  can  then  be  evaluated 
using  standard  techniques  discussed  in  Section  2.1  under  model 
eva luat i on . 
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DATA 

PRIMARY  SOURCE 

SECONDARY  SOURCE 

Pt(1  ) 

AFTO  781  E  Form 

AFTO  349  Form 
(AFM  66-1  -  MDCS) 

CEMS  IV  Database 

q^l) 

AFTO  781  E  Form 

AFTO  349  Form 
(AFM  66-1  -  MDCS) 

CEMS  IV  Database 

^(J) 

AFTO  781  E  Form 

AFTO  349  Form 
(AFM  66-1  -  MDCS) 

CEMS  IV  Database 

Freqs.  of  Events 

CEMS  IV  Database 

TEMS  Squadron  Test  Log 

Costs  $ 

AF  Cost  Standards 

(Quantitative  Judgment  (Interviews) 

Manhours 

AFM  66-1  (MDCS) 

Engine  Downtime 

AFTO  1534  Form 
(D0R4  Status  Reporting) 

AFTO  349 

(AFM  66-1  -  MDCS) 

* 

Engine  Test  Hrs. /Cycles 

TEMS  Test  Log 

Fault  Distribution 


Manufacturer  Support  Data  System 


V.  AN  EXAMPLE 


To  illustrate  the  decision  analysis  model  evaluation 
procedure,  a  simple  example  is  now  solved.  The  portion  of  the 
high  level  block  diagram  without  TEMS  for  the  symptom  of 
overtemp,  other  than  during  start  cycle  has  been  expanded  to 
include  alternative  decisions  to  Air  Force  policy  as  described  in 
TO-2JTF34-6.  An  option  has  been  added  for  doing  a  ground  run  or 
not  in  the  maintenance  check.  Following  this  check,  an  option  to 
troubleshoot  (includes  maintenance)  or  not  has  been  added  except 
in  the  case  where  a  ground  run  is  done  and  the  symptom  is 
duplicated.  In  i:his  case,  it  has  been  assumed  that 
troubleshooting  will  always  be  done.  Note  that  the  level  of 
troubleshooting  is  greater  following  a  ground  run. 

Troubleshooting  without  a  ground  run  would  only  be  a  simple 
procedure  capable  of  detecting  and  fixing  only  minor  problems. 

The  input  data  were  selected  to  exhibit  the  following 
"reasonable”  properties:  For  this  symptom,  duplication  through  a 
ground  run  is  unlikely.  Also,  the  probability  that  an  engine 
functional  check  turns  out  okay  is  proportional  to  the  extent  of 
troubleshooting.  Thus  the  minimal  troubleshooting  done  without  a 
ground  run,  while  not  costing  much,  does  not  yield  much  chance  of 
working  engine. 

The  "costs"  are  "relative"  factors  intended  to  encompass  all 
quantitative  and  qualitative  objectives  into  a  single  number  on  a 
scale  of  1-10,  ten  being  the  most  expensive  or  the  "worst". 

Again,  the  cost  of  the  more  extensive  troubleshoot  following  a 
ground  run  is  i^uch  higher. 

The  utility  function  has  been  assumed  to  be  linear  so  the 
decision-maker  is  choosing  an  option  based  on  expected  value 
outcome . 

Figure  2.2  exhibits  the  decision  tree  for  this  example. 
Notation  is  the  same  as  for  the  models  of  Section  III  with 
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additions  listed  on  the  figure.  Probabilities  of  chance  fork 
outcomes  are  in  parentheses  while  costs  and  values  are  circled. 

Table  5.1  shows  the  solution  to  the  example.  There  are  four 


possible 

pol  i 

c  ies : 

(1) 

Gt: 

do  a  ground  run  and 
then  troubleshoot 

if  symptom  not  duplicated 

(2 ) 

Gt: 

do  a  ground  run  and 
duplicated,  do  not 
policy) 

if  symptom  not 
troubleshoot  (TO  2JTF34-6 

(3) 

Gt: 

do  not  do  a  ground 
troubleshoot 

run  and  do  minor 

(4) 

Gt": 

do  not  do  a  ground  run  and  do  not 
troubleshoot  (ignore  the  problem) 

In  this  case  the  optimal  policy  turns  out  to  be  Gt  with  a  mean 
cost  of  6.35. 


VI.  CONCLUSIONS  AND  RECOMMENDED  FUTURE  WORK 


In  this  section,  SCT’s  conclusions  resulting  from  this  study 
as  well  as  an  outline  for  recommended  future  work  will  be 
presented . 

The  main  points  to  be  learned  from  this  study  are: 

•  The  technique  of  decision  analysis  is  a  very 
flexible  and  useful  tool  for  determining  optimal 
maintenance  procedures,  optimal  decision  making 
techniques  (human  factors)  and  optimal  utilization 
of  TEMS  information. 

•  To  pursue  a  maintenance  decision  analysis  and 
improvement  program  optimally,  accounting  for 
human  as  well  as  logistics  factors,  decision 
analysis  is  an  ideal  tool.  It  has  already  been 
applied  successfully  in  numerous  areas  in  medicine 
and  management.  Any  group  attempting  to  attempt 
such  an  effort  should  have  expertise  in  decision 
analysis  methods,  human  factors  and  the  logistics 
of  TF34  maintenance.  This  supports  the  conclusion 
made  in  Ref.  12. 

•  Data  is  available  for  model  evaluation.  A  unique 
opportunity  exists  to  use  CEMS  IV  to  collect  data 
for  analysis  of  decision  making  methods  and  for 
input  into  maintenance  decision  analysis  models. 

The  period  of  this  opportunity  will  extend  from 
October  1982  through  October  1983. 

•  A  need  exists  for  a  study  as  outlined  in  the 
previous  conclusions.  The  remainder  of  this 
section  outlines  some  of  the  issues  involved,  work 
breakdown  structure  and  a  schedule  of  events  for 
such  a  study. 

Henceforth,  future  work  in  this  area  will  be  referred  to 
under  the  header:  "Maintenance  Decision  Analysis  and  Improvement 
Program"  (MDAIP).  The  objectives  of  the  program  will  be  to: 

(1)  Evaluate  TEMS  through  decision  model  analysis 

accounting  for  both  human  and  logistics  factors. 

This  will  occur  in  Phase  I  of  the  proposed  work 
breakdown  structure  appearing  in  Table  6.1. 
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TASK  6:  -  PREPARE  DOCUMENTATION 


(2) 


Determine  optimal  policies  to  help  Air  Force  set 
guidelines  for  maintenance  with  TEMS.  These 
policies  should  include  maintenance  procedures, 
decision  making  techniques  and  incorporate  optimal 
usage  of  TEMS  information.  This  effort  will  occur 
as  Phase  II  of  the  proposed  program. 

Phase  I  will  involve  running  through  the  decision  analysis 
cycle  the  first  time  using  only  a  moderate  data  collection 
effort,  while  testing  the  models.  Task  1  involves  the  selection 
of  hardware  on  which  to  perform  the  analysis.  The  models  of 
Section  III  amplified  to  incorporate  certain  key  decisions  will 
be  installed  on  the  selected  hardware  as  part  of  Task  2.  All 
software  developed  or  used  in  Phase  I  should  be  in  suitable 
format  for  easy  model  revision  in  Phase  II.  In  Tasks  3  and  4, 
input  data  will  then  be  collected  from  sources  requiring  only  a 
moderate  collection  effort  and  the  models  evaluated  (with  and 
without  TEMS).  Evaluation  will  encompass  current  maintenance 
strategy,  decision  making  methods  and  automated  equipment 
installation.  Documentation  of  these  results  occurs  as  Task  5. 

Phase  II,  the  major  thrust  of  this  future  effort  will 
involve  the  investigation  of  alternative  maintenance  decisions 
and  decision  making  methods  possible  under  TEMS.  In  task  1, 
alternatives  will  be  investigated  in.  Possible  alternatives  will 
be  examined  for  both  the  high  level  models  (initial  ground  runs? 
levels  of  troubleshooting?)  and  the  detailed  models  (changing 
details  of  maintenance  process).  Items  influencing  the  choice  of 
maintenance  decision  alternatives  include  BITE  and  automated 
monitoring  unit  (AMU)  effectiveness  as  well  as  decision-maker 
reliability,  validity  and  efficiency. 

Following  the  investigation  of  alternative  decisions,  a 
measurement  plan  (Task  2)  will  be  developed  for  collection  of 
data  for  input  to  a  revision  of  the  Phase  I  model.  This  plan 
will  be  one  for  which  the  expected  benefits  in  terms  of  model 
results  exceed  the  expected  cost  of  data  acquisition. 

In  Tasks  3  and  4,  the  measurement  plan  will  be  carried  out 
and  model  evaluation  performed.  Based  on  these  results, 
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corrective  measures  for  optimizing  Air  Force  maintenance  under 
TEMS  will  be  recommended.  These  will  then  be  implemented  in  a 
field  test  to  validate  model  results.  Results  will  be  documented 
(Tasks  5  and  6).  Table  6.2  presents  a  proposed  two-year  schedule 
for  MDAIP  performance. 
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Table  6.2 

Maintenance  Decision  Analysis  and  Improvement  Program  Schedule 


ORAL  STATUS  REVIEW 


VII.  ADDITIONAL  DETAILED  DIAGRAMS  FOR  TF34 
MAINTENANCE  PROCESS 


The  following  set  of  block  diagrams  provide  additional 
details  on  the  TF34  maintenance  process.  These  diagrams  have 
been  tailored  to  provide  a  clear  understanding  of  the  range  of 
decisions  and  maintenance  actions  over  all  possible  symptoms  as 
well  as  to  point  out  where  the  human  or  judgemental  factors  enter 
into  the  models. 

Two  types  of  diagrams  are  included:  full  detailed  diagrams 
for  symptom  1  (overtemp,  nonstart  cycle)  and  subsets  of  detailed 
block  diagrams  consisting  of  paths  leading  to  an  engine  removal 
or  replacement  decision. 

Figures  7.1  and  7.2,  full  detailed  block  diagrams,  are 
nearly  identical  to  Figures  3.4  and  3.5  except  for  minor 
modifications  introduced  to  emphasize  the  decision  points  in  the 
maintenance  flow,  even  when  restricted  to  policies  specified  in 
Refs.  9  and  10.  Each  check  labeled  with  a  "C"  is  performed  by  a 
maintenance  specialist  and  as  such  the  outcome  is  affected  by  his 
judgement.  Decisions  resulting  from  checks  labeled  with  "T”  are 
based  on  TEMS  display  lights  and  can  be  considered  to  be 
non- judgemental  in  nature.  The  key  to  Figures  7.1  and  7.2  is 
found  in  Tables  3.3  through  3.5.  Diagonal  shaped  boxes  have 
replaced  circles  to  represent  decison  points  in  the  maintenance 
process . 

Figures  7.3  through  7.10  are  subsets  of  the  full  detailed 
block  diagrams.  Only  decisions  which  could  lead  to  an  engine 
removal  are  pictured.  Notation  is  the  same  as  for  other  detailed 
diagrams:  ellipses  represent  inputs  while  diamonds  represent 
decisions  based  on  the  results  of  various  checks  or  inspections 
specified  by  the  code  inside  the  box.  These  codes  are  explained 
in  Table  7.1.  Rectangular  boxes  represent  simple  actions  while 
"R"  represents  the  outcome  of  engine  removal  or  replacement. 
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Figure  7.2  Revised  Detailed  Flow  Diagram,  With  TEMS 


Figure  7.4  Symptom  1' 
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Figure  7.5  Symptom  2 


Syaptoa  5:  Vibrations 

Decisions  Leading  To  Engine  Removals 


Symptom  5 
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Figure  7.9  Symptom  8 


NO  TENS 


Symptom  It):  Stall 

Decisions  Leading  To  Engine  Removals 


rots 


Figure  7.10  Symptom  10 


Table  7.1 


Key  to  Figures  7.3  Through  7.10 


CODE  TO  DECISION  DIAGRAM  SYMBOLS 


SYMPTOM  # 

FOR  WHICH 

CHECK  IS  DONE 

(1,  1',  2,  4,  5,  7,  8,  10) 


TYPE  OF 
CHECK: 

SPECIALIST  JUDGMENT  (C) 
OR  TEMS  (T) 


NUMERICAL 

IDENTIFIER 

1.  2,  3 


:  A  DECISION 

| - 1  :  AN  ACTION 

A  :  OUTCOME  OF  ENGINE  REMOVAL  OR  REPLACEMENT 
O  ;  INPUT  0R  SYMPTOM  DETECTION 


Undershaded  blocks  indicate  dlf i  nces  between  maintenance  procedures  with  and 
without  TEMS. 
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Table  7.1  (Continued) 


# 

CHECKS/DECISIONS  WITHOUT  TEMS 

CHECK  (INPUT  TO  DECISION)  DECISIONS 

1C1 

CHECK  ITT  READINGS 

1: 

ITT  EXCEEDS  LIMITS 

0: 

ITT  DOES  NOT  EXCEED  LIMITS 

ITT  LIMITS  (STARTING  CYCLE): 

1010°C, 

2  SEC. 

930°C, 

5  SEC. 

870°Ct 

25  SEC. 

860°C, 

50  SEC. 

1C2 

CHECK  ITT  READINGS 

1: 

ITT  EXCEEDS  LIMITS 

RESULTS  Of  PREVIOUS  START 

0: 

ITT  DOES  NOT  EXCEED  LIMITS 

1C3 

CHECK  ITT  INDICATOR 

1: 

BAD 

0: 

OKAY 

1C4 

CHECK  STARTING  SYSTEM 

1: 

BAD 

0: 

OKAY 

1C5 

CHECK  STATOR  VANES 

1: 

ARMS  POPPED 

0: 

OKAY 

1C6 

CHECK  VG  FEEDBACK  CABLE 

1: 

HUNG  UP  OR  BOUND  UP 

- 

0: 

TRAVELS  FREELY 

1C7 

REMOVE  &  INSPECT  LPT  MODULE 

1: 

BAD 

0: 

OKAY 

Table  7.1  (Continued) 


# 

• 

CHECKS/DECISIONS  WITHOUT  TEMS 

CHECK  (INPUT  TO  DECISION)  DECISIONS 

l'Cl 

CHECK  ITT  READINGS 

3: 

ITT  >  1000°C 

2: 

927  <  ITT  <  100G°C 

1: 

830  <  ITT  7  927°C 

0: 

ITT  <  ^30°? 

1 '  C2 

CHECK  Ng/ITT  INDICATOR 

1: 

BAD 

0: 

OKAY 

rc3 

CONTROL  DISABLE  CHECK 

1: 

CHECK  NOT  OKAY 

0: 

CHECK  OKAY 

l'C4 

CHECK  WHETHER  Ng  REACHES  99-100* 

1: 

YES 

BUT  ITT  &  Ng  REMAIN  LOW 

0:' 

NO 

1 '  C5 

CHECK  VG  FEEDBACK  CABLE 

1: 

NOT  SECURE 

FOR  SECURITY 

0: 

SECURE 

rc6 

CHECK  VG  FEEDBACK  CABLE 

1: 

BOUND  UP 

FOR  BINDING 

0: 

OKAY 

l'C7 

DISCONNECT  VG  FEEDBACK  CABLE 

1: 

>  4LB.  FORCE  REQUIRED 

AND  SEE  HOW  MUCH  FORCE  REQUIRED 

0: 

<  4LB.  FORCE  REQUIRED 

TO  MOVE  IT 

res 

CHECK  FUEL  CONTROL  FEEDBACK 

2: 

HUNG  UP 

LEVER  ARM 

1: 

BINDING 

0: 

OKAY 
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Table  7.1  (Continued) 


I 

CHECKS/DECISIONS  WITHOUT  TEMS 

CHECK  (INPUT  TO  DECISION)  DECISIONS 

4C1 

INSPECT  FOR  LARGE  OIL 

1: 

LARGE  LEAKAGE 

LEAKAGE 

0: 

NO  LARGE  LEAKAGE 

4C2 

CHECK  FOR  HIGH  OIL 

Is 

HIGH  CONSUMPTION  FOUND 

CONSUMPTION 

0: 

NO  HIGH  CONSUMPTION 

4C3 

CHECK  OIL  TEKP. 

1: 

LOU 

0: 

OK 

4C4 

CHECK  OIL  PRESSURE 

Is 

8AD 

INDICATORS 

0: 

OKAY 

4C5 

CHECK  OIL  FILTER 

Is 

CHIPS 

0: 

NO  CHIPS 

4C6 

CHECK  OIL  LINES 

1: 

LINES  KINKED  OR  BLOCKED 

0: 

LINES  NOT  KINKED  OR  BLOCKED 

4C7 

CHECK  CHIP  DETECTORS 

Is 

CHIPS 

0: 

NO  CHIPS 

5C1 

CHECK  VIBRATION  INDICATOR 

*  1: 

BAD 

SYSTEM 

0: 

OKAY 

5C2 

CHECK  ENGINE  MOUNTS 

Is 

BAD 

0: 

OKAY 

5C3 

CHECK  OIL  PRESSURE 

1: 

BAD 

0: 

OKAY 

5C4 

RESULTS  OF  TROUBLESHOOTING 

1: 

CHIPS  (REJECT  ENGINE) 

CHIPS  (SYMPTOM  8) 

0: 

INSUFFICIENT  CHIPS  TO  REJECT 

5C5 

CHECK  FOR  ROTOR  SPEED 

1: 

PROBLEMS 

PROBLEM 

0: 

NO  PROBLEMS 

5C6 

CHECK  FOR  COMPRESSOR  ROTOR 

Is 

IMBALANCE  DETECTED 

IMBALANCE  USING  VIB  SCAN 

0: 

OKAY 
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Table  7.1  (Continued) 


CHECKS/DECISIONS  WITHOUT  TEMS 

# 

CHECK  (INPUT  TO  DECISION) 

DECISIONS 

6C7 

CHECK  FAN  OISK  BRUSHING 

1: 

BAD 

MOVEMENT 

0: 

OKAY 

5C8 

INSPECT  FAN  AND  LPT 

1: 

PROBLEMS 

ROTOR 

0: 

OKAY 

5C9 

CHECK  FOR  LPT  ROTOR 

1: 

IMBALANCE  DETECTED 

IMBALANCE 

0: 

NO  IMBALANCE 

5C10 

CHECK  FOR  FAN  ROTOR 

Is 

IMBALANCE  DETECTED 

IMBALANCE 

0: 

NO  IMBALANCE 

7C1 

CHECK  AIRCRAFT  IMPENDING 

1: 

ON 

BYPASS  INDICATOR 

0: 

OFF 

CVJ 

CHECK  FUEL  FILTER  BYPASS 

1: 

BUTTON  POPPED 

BUTTON 

0: 

BUTTON  NOT  POPPED 

8C1 

CHECK  FOR  CONTAMINATION  ON 

1: 

CHIPS  ON  PLUG 

PLUG 

C: 

NORMAL  FUZZ  OR  SMALL  SLIVERS 

8C2 

INSPECT  LUBE  FILTER 

Is 

DIRTY 

0: 

CLEAN 

8C3 

DRAIN  OIL  TANK,  CHECK 

Is 

CONTAMINATION  IN  ENTIRE  SYSTEM 

FOR  CONTAMINATION 

0: 

MINOR  CONTAMINATION 

10C1 

PILOT  REPORT  (ENGINE 

1: 

VIBRATION  LIMITS  EXCEEDED 

OPERATED  OUTSIDE  OF  NORMAL 

LIMITS?) 

0: 

LIMITS  NOT  EXCEEDED 

10C2 

INSPECT  LUBE  FILTER 

1: 

HEAVY  METAL  CHIPS 

0: 

NO  CHIPS 

10C3 

INSPECT  CHIP  DETECTORS 

1: 

HEAVY  METAL  CHIPS 

0: 

NO  CHIPS 

10C4 

CHECK  FEEDBACK  CABLE 

Is 

HUNG  UP 

(FUEL  CONTROL  FEEDBACK  LEVER  ARM) 

0: 

NOT  HUNG  UP 
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Table  7.1  (Continued) 


CHECKS/DECISIONS  WITHOUT  TEHS 

# 

CHECK  (INPUT  TO  DECISION) 

DECISIONS 

10C5 

CHECK  STATOR  SCHEDULE 

1: 

>  4°  OPEN  AT  SiX  Ng. 

0: 

<  40  OPEN  AT  92X 

10C6 

CHECK  Ng 

1: 

BAD 

0: 

OKAY 

10C7 

STALL  TEST  RESULTS 

1: 

STALL  AFTER  REPLACE  MFC 

0: 

NO  STALL  OR  MFC  NOT  REPLACED 

Table  7.1  (Continued) 


CHECKS/DECISIONS  WITH  TEMS 

I 

CHECK  (INPUT  TO  DECISION) 

DECISIONS 

1T1 

DDU  FI,  Gil,  B4 

1: 

ITT  >  1000°C,  >  2  SEC. 

0: 

ITT  NOT  >  1000°C  FOR  >  2  SEC. 

1T2 

DDU  FI,  GIO,  84 

1: 

ITT  >  927°C,  >  5  SEC. 

0: 

in  MOT  >  927°C  FOR  >  5  SEC. 

1T3 

DDU  G8 

1: 

INSUFFICIENT  COOLDOWN  BETWEEN 
STARTS 

0: 

SUFFICIENT  COOLDOWN 

l'Tl 

DDU  G-7  (WF  OVERRIDE) 

2: 

ON,  PILOT  DID  NOT  SELECT 

PILOT 

1: 

ON,  PILOT  SELECTED 

0: 

NOT  ON 

l'T2 

DDU  FI 

2: 

LEVEL  2 

1: 

LEVEL  1 

0: 

NOT  ON 

1  *  T3 

DDU  GIO,  Gil,  84 

2: 

ITT  >  1000°C 

1: 

ITT  BETWEEN  927°C  &  1000<>C 

0: 

ITT  <  927°C 

1 '  T4 

COMPARE  DDU  Bl,  B4,  85,  Cl 

1: 

ALL  AGREE  EXCEPT  B4 

FROM  LEFT  AND  RIGHT  ENGINES 

0: 

NOT  OPTION  1 

l'TS 

DDU  FIO 

1: 

STALL  OCCURRED 

0: 

NO  STALL 

2T1 

DDU  Cl  (Ng) 

2: 

102-104.5*,  >  2  SECS. 

1: 

ABOVE  99.4*,  BUT  ABOVE 

102*  FOR  <  2  SECS. 

0: 

LESS  THAN  99.4a 

2T2 

DDU  C2  (Nf) 

2: 

ABOVE  100*  OR  ABOVE 

99.7*  FOR  >  3  SEC. 

1: 

94.5*  TO  99.7*  OR 

99.7*  TO  100*  FOR  <  3  SEC. 

2C1-2T1 

2C1,  2T1  DECISIONS 

Y: 

YES,  THEY'RE  THE  SAME 

N: 

NO,  THEY'RE  NOT 

Table  7.1  (Continued) 


CHECKS/DECISIONS  WITH  TEMS 

# 

CHECK  (INPUT  TO  DECISION) 

DECISIONS 

• 

2C2-2T2  2C2,  2T2  DECISIONS 
2T3  DOU  F2 

4T1  DOU  F-8 

5T1  DOU  F-5  (VIBRATIONS) 

5T2  DDU  F-8  (CHIPS) 

5T3  DDU  F-l,  F-2  (OVERTEMP, 

OVERSPEED) 

5T4  DDU  E3-+E8 

(VIBRATION  LEVELS) 

5T5  DDU  F-2  (Nf  OVERSPEED) 

10T1  DDU  G-6  (SLATS/HIGH  AOA) 

10T2  DDU  F-8 

10T3  DDU  F-7 

10T4  DDU  F-ll,  D-8 

10T5  DDU  F-9 


YES,  THEY'RE  THE  SAME 
NO,  THEY'RE  NOT 

OVERSPEED 
NO  OVERSPEED 

LIGHT  ON  (CHIPS) 

LIGHT  NOT  ON  (NO  CHIPS) 

LEVEL  2  (VIBRATIONS) 

LEVEL  1 
NOT  ON 

ON  (CHIPS) 

NOT  ON  (NO  CHIPS) 

F-l  OR  F-2  ON  (OVERSPEED  OR 
OVERTEMP) 

NEITHER  ON 

DETECT  COMPRESSOR  ROTOR  IMBALANCE 
NO  PROBLEM  DETECTED 

LEVEL  2 
LEVEL  1 
LIGHT  NOT  ON 

« 

OVER  g's  BUT  AOA  NOT  TOO  GREAT 
NOT  1 

LIT  (CHIPS) 

NOT  LIT  (NO  CHIPS) 

LIT  (FUEL  FILTER  CONTAM.) 

NOT  LIT  (NO  CONTAM.) 

VG  OUT  OF  LIMITS 
VG  NOT  OUT  OF  LIMITS 

Ng  OUT  (LIT) 

Ng  OKAY  (NOT  LIT) 


Table  7.1  (Concluded) 


OTHER  CHECKS 


CHECK  (INPUT  TO  DECISION) 

DECISIONS 

RESULTS  OF  BORESCOPE 

1: 

BAD 

INSPECTION 

0: 

OKAY 

RESULTS  OF  SOAP 

1: 

BAD( IMPENDING  BEARING  FAILURE) 

REPORTS 

0: 

OKAY 

For  each  symptom,  block  diagrams  for  procedures  without  and 
with  TEMS  appear  side  by  side.  Blocks  representing  actions  which 
differ  depending  on  the  presence  of  TEMS  are  undershaded  to 
emphasize  changes  in  procedure  due  to  TEMS.  Only  eight  TEMS 
detectable  symptoms  can  possibly  lead  to  an  engine  removal; 
therefore  symptoms  3,  6,  9  and  11  do  not  appear  in  Figures  7.3  to 
7.10. 

To  conclude  this  section,  Table  7.2  provides  a  complete 
listing  of  TF34  repair  or  replacement  actions.  These  include 
actions  resulting  from  TEMS-detectable  symptoms  as  well  as  other 
symptoms.  Nearly  all  the  actions  can  occur  as  a  result  of  a 
TEMS'detectable  symptom. 
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Table  7.2 

List  of  Possible  TF34  Repair/Replacement  Maintenance  Actions 


{  REPLACE  IGNITER  PLUGS 

l 

REPLACE  FAULTY  COMPONENTS  IN  IGNITER  CIRCUIT 

REPLACE  FAULTY  IGNITION  EXCITER 

REFILL  FUEL  TANKS 

ATTEMPT  TO  START  ENGINE 

BLEED  AIR  FROM  SUPPLY  LINES 

ADJUST  THROTTLE  RIGGING  (OR  RERIG  THROTTLE) 

ADJUST  STARTER  AIR  PRESSURE 

REPAIR  OVERBOARD  DRAINS  (TIGHTEN  FITTINGS  OR  REPLACE  DEFECTIVE  COMPONENT) 

REPLACE  FUEL  PUMP 
REPLACE  FUEL  CONTROL 
REMOVE  ENGINE  (REPLACE  PTO) 

RERIG  PLA  (POWER  LEVER  ANGLE) 

DISCONNECT/RECONNECT  PRIMER  VALUE  INLET  HOSE 
MAKE  WET  ROLLOVER  (PURGE  FUEL  FROM  ENGINE) 

REPLACE  TACH  GENERATOR 
REPLACE  NG  INDICATOR  OR  HARNESS 
REPLACE  STARTER 

REPLACE  STARTER  CUTOUT  SPEED  SWITCH 

REPLACE  STARTER  AIR  SHUTOFF  VALVE  (ALSO  TIGHTEN  CONNECTOR  OR  REPLACE  LEAD) 

REPAIR  POWER  SUPPLY  (REF.  STARTER  AIR  VALVE  SOLENOID)  OR  CORRECT  INPUT  POWER  SUPPLY 
REPLACE  START  SWITCH 

REPLACE  RADIAL  DRIVE  SHAFT  (REF.  GAS  GENERATOR) 

REPLACE  ENGINE 

REPLACE  ENGINE  (FOD  REPAIR) 


73 


Table  7.2  (Continued) 


REPLACE  T5  INDICATOR 
ADJUST  VG  SCHEDULE 

RECONNECT  TURNBUCKLES  BETWEEN  UNION  RINGS  AND  ACTUATOR  SHAFT 

RECONNECT  ACTUATORS  TO  TORQUE  SHAFTS 

RETURN  ENGINE  TO  ASSEMBLY 

RERIG  FEEDBACK  CABLE 

REPLACE  FEEDBACK  CABLE 

REMOVE  AND  REPAIR  COMPRESSOR 

REMOVE  AND  REPAIR  HPT  TURBINE 

REMOVE  LPT  MODULE  AND  INSPECT 

REMOVE  ENGINE  AND  REPAIR  DEFECTIVE  LPT  MODULE 

REPLACE  T2  SENSOR 

CORRECT  COMPRESSOR  BLEED  AIR  LEAKAGE 

REPLACE  FUEL  DISTRIBUTOR 

REPLACE  CIT  SENSOR 

TIGHTEN  OR  REPLACE  P3  SENSING  LINES 

REPLACE  OR  RECALIBRATE  IDLE  SPEED  INDICATOR 

ADJUST  IDLE  SPEED  SETTING  ON  FUEL  CONTROL 

REMOVE  FUEL  CONTROL  AND  REPLACE  FUEL  PUMP  TO  CONTROL  DRIVE  SHAFT 
DRAIN  AND  REFILL  FUEL  SYSTEM 

REPLACE  FAULTY  FAN  COMPONENT  (INDICATOR,  SPEED  SENSOR,  RED  ELECTRICAL  CABLE) 

MELT  ICE  WITH  PORTABLE  HEATERS 

REPLACE  ETTR 
* 

REPAIR/REPLACE  POWER  LEVER  LINKAGE 
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Table  7.2  (Continued) 


TIGHTEN  OR  REPLACE  COMPRESSOR  0ISCHAR6E  PRESSURE  SYSTEM  LINES 
REPLACE  CONTROL  AMPLIFIER 
REDUCE  BLEED  OR  POWER  EXTRACTION 

REPAIR/REPLACE  TERMOCOUPLE  OR  WHITE  HARNESS  (T5  ELECTRICAL  SYSTEM) 

REPAIR/REPLACE  P3  TUBE  OR  ACCUMULATOR 

CONNECT/TIGHTEN  OR  REPLACE  8LACK  HARNESS  OF  MFC  (CONNECTS  TO  MFC  ROTARY  RATE  TRANSDUCER) 
REPAIR  HARNESS  OR  SWITCH  (IN  AIRFRAME  WIRING) 

REPLACE  DENTED  TUBING/FAULTY  HOSES 
REPLACE  OIL  COOLER  CHECK  VALVE 
REPLACE  T5  AMPLIFIER 

REMOVE  ENGINE  AND  REPLACE  STAGE  COMPRESSOR  ROTOR  BLADES 

REMOVE  AND  INSPECT  FUEL  FILTER  AND  CHIP  DETECTORS 

REPLACE  FUEL  FILTER 

CONDUCT  30  MINUTE  GROUND  RUN 

ADD  OIL  TO  TANK 

REPLACE  OIL  SUPPLY  LINES  OR  FITTINGS 
REPLACE  C-SUMP  COVER  OR  COVER  PACKINGS 
REPLACE  PACKINGS  IN  OIL  FILL  CAP 

REPLACE  ALL  OR  FAULTY  COMPONENTS  IN  OIL  PRESSURE  INDICATOR 

REPLACE  OIL  TANK  PRESSURIZING  VALVE 

REPLACE  OIL  COOLER 

CLEAN/REPLACE  LUBE  FILTER 
PERFORM  JOAP  CHECK 


BORESCOPE  ENGINE 


Table  7.2  (Concluded) 


CLT  ^/REPLACE  OIL  PUP  RELIEF  VALVE 
INSTALL  LUBE  FILTER  CHECK  VAL  ORRECTLY 

REPLACE/TIGHTFN  TRANSMITTER,  PUMP,  COMBUSTION,  or  B-SUMP  SCAVENGE  LINE 

REPLACE  Oil  PRESSURE  TRANSMITTER 

REPLACE  OIL  PUMP-fACH  PAP  SEAL  OR  lACE  PUMP 

REPLACE  LUBE  PUMP 

REPLACE  A-SUMP  OR  INTERSHA!  f  LA8RYINTF  OR  NO.  7  CARBON  SEAL 

REPAP  ACCESSORY  GEARBOX 

BRAZE  REPAIR  ON  TUBES  INSIDE  EXHAUST  FRAME 

RUN  ENGINE  AT  IDLE  WITH  CENTERBODY  REMOVFD  (FACILITATES  LEAK  CHECK) 

REPLACE  AIR  PRESSURE  REGULATOR  VALVE 

REPAIR  C-Sl'MP  (SCAVENGE  REPLACE  LINES,  REPAIR  LEAKS) 

REPAIR  VIBRATION  SYSTEf  INOICATOR 
RESEAT  FAN  BLADE  BUSHINGS  (SEC.  V) 

REPLACE  LOW  PRESSURE  TURBINE  ROTOR  (LPT) 

REAlIGN/TIGHTEN  ENGINE  MOUNTS 
REPLACE  FAN  ROTOR 
OORRFCT  FUEL  SYSTEM  HO.r,r  ROUTING 
REPLACE  FUFL  DISTRIBUTOR 
REPLACE  Np  PIGOJP 


REFERENCES 


1.  SRI  International  Decision  Analysis  Group,  Readings  in 
Decision  Analysis,  Menlo  Park,  Calif.  1977. 

2.  Raiffa,  Howard,  Decision  Analysis:  Introductory  lectures  on 
Choices  under  Uncertainty,  Addison-Wesley  1968. 

3.  Keefer,  D.L.  and  Pollock,  S.M.,  "Approximations  and 

Sensitivity  in  Multi -objective  Resource  Allocation,"  Opns. 
Res.,  28  #1,  1980,  114-128.  - 

4.  Kri scher ,  Jeffrey  P.,  "An  Automated  Bibliography  of  Decision 
Analytic  Applications  to  Health  Care,"  Opns.  Res.,  28  #1, 
1980,  97-113. 

5.  Eddy,  David  M.,  Screening  for  Cancer,  Theory  Analysis  and 
Design ,  Prentice-Hall,  Englewood  Cliffs,  NT,  1950. 

6.  Fischoff,  Baruch,  "Clinical  Decision  Analysis,"  Opns.  Res., 

28  II,  1980,  28-43.  - 

7.  Department  of  the  Air  Force,  AF  Regulation  66-5,  Production 
Oriented  Maintenance  Organization,  15  July  1979. 

8.  Department  of  the  Air  Force,  AF  Manual  66-1. 

9.  Department  of  the  Air  Force,  T.O.  2J  TF34-6,  Chapters  IX,  X. 

10.  Northrop  Electronics  Division,  USAF  A-10  TEMS  Training  Manual 

11.  NORT  78-12,  A-10  TEMS  Operating  Instructions,  Sec.  6.0. 

12.  Herner,  Alan,  Miller,  T.M.  and  Genet,  Russell,  Diagnostic 
Errors  and  Human  Factors  in  Built  in  Test,  April  7,  1981. 


77 


